Non-transitory computer readable medium, information processing apparatus, and information processing method for determining a location of a target based on image information generated by capturing an image of the target

ABSTRACT

A non-transitory computer readable medium stores a program causing a computer to execute a managing process. The managing process includes determining a location of a photo-shooting target based on photo-shooting information of image information, the image information being generated by capturing the photo-shooting target, and associating at least one shop with the captured image, with reference to location information of plural shops that has been registered in advance.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. application Ser. No.14/695,572 filed Apr. 24, 2015, which is based on and claims priorityunder 35 USC 119 from Japanese Patent Application No. 2014-247772 filedDec. 8, 2014.

BACKGROUND Technical Field

The present invention relates to a non-transitory computer readablemedium, an information processing apparatus, and an informationprocessing method.

SUMMARY

According to an aspect of the invention, there is provided anon-transitory computer readable medium storing a program causing acomputer to execute a managing process. The managing process includesdetermining a location of a photo-shooting target based onphoto-shooting information of image information, the image informationbeing generated by capturing the photo-shooting target, and associatingat least one shop with the captured image, with reference to locationinformation of plural shops that has been registered in advance.

BRIEF DESCRIPTION OF THE DRAWINGS

Exemplary embodiments of the present invention will be described indetail based on the following figures, wherein:

FIG. 1 is a schematic diagram illustrating an example of theconfiguration of an information processing system according to anexemplary embodiment;

FIG. 2 is a block diagram illustrating an example of the configurationof an information processing server according to the exemplaryembodiment;

FIG. 3 is a block diagram illustrating an example of the configurationof a portable terminal according to the exemplary embodiment;

FIG. 4 is a schematic diagram illustrating an example of theconfiguration of product information;

FIG. 5 is a schematic diagram illustrating an example of theconfiguration of shop information;

FIG. 6 is a schematic diagram illustrating an example of theconfiguration of catalog information;

FIGS. 7A to 7D are schematic diagrams illustrating an example of anoperation on the side of the portable terminal;

FIG. 8 is a flowchart illustrating an example of an operation of theinformation processing server; and

FIGS. 9A and 9B are schematic diagrams illustrating an example of anoperation of a shop management portion.

DETAILED DESCRIPTION Exemplary Embodiment

(Configuration of Information Processing System)

FIG. 1 is a schematic diagram illustrating an example of theconfiguration of an information processing system according to anexemplary embodiment.

This information processing system is constituted by connecting aninformation processing server 1, a portable terminal 2, and terminals 3a and 3 b through a network 5 such that communication is possible. Theportable terminal 2 is operated by a user 4. The terminals 3 a and 3 bare installed in shops 30 a and 30 b, respectively, and are operated byshop clerks of the respective shops 30 a and 30 b.

With the above-described configuration, when there is a product that hascaptured the interest of the user 4 among products 300 a and 300 b in ornear the shop 30 a or 30 b, the user 4 treats this product as aphoto-shooting target and captures an image of this product using theportable terminal 2. The image information of the captured image of theproduct is transmitted together with photo-shooting information via thenetwork 5 to the information processing server 1. The informationprocessing server 1 determines a shop where the product the image ofwhich is represented by the image information is handled, transmits theimage information to a terminal, a destination, installed in the shop,requests confirmation of information on the product, and acquires aconfirmation. The information processing server 1 associates theacquired information on the product with the image information andtransmits the resulting information in a catalog format to the portableterminal 2. The user 4 views a catalog using the portable terminal 2 andperforms a purchase process if there is a product that captures theinterest of the user 4.

The information processing server 1 is a server-type informationprocessing apparatus and operates in accordance with a request issued bythe portable terminal 2. The information processing server 1 includeselectronic components in the main body, such as a central processingunit (CPU), a flash memory, and the like, the CPU having a function withwhich information is processed.

The portable terminal 2 is a portable phone, a tablet, or the like andincludes, in the main body, a camera for capturing an image of aproduct, a Global Positioning System (GPS) for acquiring locationinformation, an acceleration sensor that detects the posture of theportable terminal 2 at the time of photo shooting, an electronic compassthat detects a photo-shooting direction, and the like in addition to aCPU and a flash memory, the CPU having a function with which informationis processed. Note that the GPS, the acceleration sensor, the electroniccompass, and the like may be included in a digital camera or the likethat is separate from the portable terminal 2 and the portable terminal2 may receive information through communication from the digital cameraor the like.

The terminals 3 a and 3 b are information processing apparatuses such aspersonal computers (PCs) and include electronic components in the mainbody, such as a central processing unit (CPU), a flash memory, and thelike, the CPU having a function with which information is processed.

The network 5 is a communication network, and examples of the network 5include a wired communication network and a wireless communicationnetwork such as the Internet, a local-area network (LAN), and the like.

Note that one information processing server 1 is illustrated in FIG. 1;however, plural information processing servers 1 may be prepared anddistributed processing may be performed on a job. In addition, oneportable terminal 2 is illustrated in FIG. 1; however, plural portableterminals 2 may be prepared in accordance with the number of users. Inaddition, the terminals 3 a and 3 b are prepared at respective shops,and the number of terminals may be reduced or increased in accordancewith the number of shops or plural terminals may also be prepared at oneshop.

(Configuration of Information Processing Apparatus)

FIG. 2 is a block diagram illustrating an example of the configurationof the information processing server 1 according to the exemplaryembodiment.

The information processing server 1 includes a controller 10, a memory11, and a communication unit 12. The controller 10 is constituted by aCPU and the like, controls various units, and executes various programs.The memory 11 is constituted by a storage medium such as a flash memoryor the like and stores information. The communication unit 12communicates with the outside through the network 5.

By executing a product management program 110, which will be describedlater, the controller 10 functions as an image receiving portion 100, aphoto-shooting information receiving portion 101, a shop managementportion 102, a product management portion 103, a product confirmationportion 104, a meta tag management portion 105, a catalog generationportion 106, a catalog display portion 107, a product order portion 108,and the like.

The image receiving portion 100 receives image information of an imagecaptured by the portable terminal 2 and transmitted from the portableterminal 2.

The photo-shooting information receiving portion 101 receivesphoto-shooting information, which is transmitted together with imageinformation from the portable terminal 2. Here, the photo-shootinginformation is information such as location information, aphoto-shooting direction, a focal length, and the like, the locationinformation indicating the location of the portable terminal 2 at thetime of capturing of an image the image information of which is receivedby the image receiving portion 100. The location information, thephoto-shooting direction, and the focal length are pieces of informationobtained from the GPS, the acceleration sensor, and the camera of theportable terminal 2, respectively.

The shop management portion 102 determines the location of a product inaccordance with photo-shooting information received by thephoto-shooting information receiving portion 101 and determines a shopthat handles a product included in at least one image represented byimage information from plural pieces of information registered in shopinformation 112. Note that the shop information 112 is information inwhich location information is associated with information on shops.

The product management portion 103 performs registration in productinformation 111 such that information on a product included in imageinformation is associated with the image information. At the time whenthe image receiving portion 100 receives image information, sinceinformation on a product is unknown, registration is performed such thatthe information on the product is left blank. At a time when theinformation on the product is acquired by the product confirmationportion 104 and the meta tag management portion 105, which will bedescribed later, the information on the product is additionallyregistered. Note that in the case where image information similar to thereceived image information has already been registered, registration maybe performed in the product information 111 by treating the product anda product corresponding to the image information that has already beenregistered as the same products.

The product confirmation portion 104 transmits image information to ashop determined by the shop management portion 102, requestsconfirmation of information on a product included in the imageinformation, receives information on the product transmitted from theshop, and performs registration in the product information 111. Specificexamples of information on a product include a product name, a stock ofthe product, a delivery time, a price, and the like. A transmissionmethod is no object as long as information is transmitted, examples ofwhich include e-mail, FAX, a message function of an SNS, and the like.Note that confirmation of a product may be automated or may also beperformed by supporting inquiries made by persons.

In the case where information on a product the same as a productincluded in an image represented by image information has beenregistered in advance, the meta tag management portion 105 registers, inthe product information 111, the information as meta tag information.

The catalog generation portion 106 generates, on a per-user basis,catalog information 113 in which image information is associated withinformation on a product in accordance with the product information 111.

The catalog display portion 107 performs processing to display thecatalog information 113 on the portable terminal 2. Specifically,display is performed such that image information of an image captured bythe portable terminal 2 is associated with information on a productincluded in the image information.

The product order portion 108 performs, when an operation is performedfor placing an order for a product at the portable terminal 2, a processfor placing an order for the product with a shop that handles theproduct.

The memory 11 stores the product management program 110, the productinformation 111, the shop information 112, the catalog information 113,and the like, the product management program 110 serving as aphoto-shooting target management program that causes the controller 10to operate as the above-described portions 100 to 108.

(Configuration of Portable Terminal)

FIG. 3 is a block diagram illustrating an example of the configurationof the portable terminal 2 according to the exemplary embodiment.

The portable terminal 2 includes a controller 20, a memory 21, animaging unit 22, a sensor 23, a communication unit 24, a display 25, andan operation unit 26. The controller 20 is constituted by a CPU and thelike, controls various units, and executes various programs. The memory21 is constituted by a storage medium such as a flash memory or the likeand stores information. The imaging unit 22 generates image informationby capturing an image. The sensor 23 is constituted by a GPS foracquiring location information, an acceleration sensor for detecting theposture of the portable terminal 2 at the time of photo shooting, anelectronic compass for detecting a photo-shooting direction, and thelike. The communication unit 24 communicates with the outside throughthe network 5. The display 25 is constituted by a liquid crystal display(LCD) or the like and displays characters and images. The operation unit26 is constituted by a switch, a touch sensor, or the like.

The controller 20 functions as an imaging portion 200, a photo-shootinginformation acquisition portion 201, a communication portion 202, acatalog information receiving portion 203, a catalog display portion204, and the like by executing a portable terminal control program 210,which will be described late.

The imaging portion 200 controls the imaging unit 22, causes the imagingunit 22 to capture an image of an imaging target, and stores imageinformation 211, which is generated, in the memory 21.

The photo-shooting information acquisition portion 201 acquiresphoto-shooting information 212 from the sensor 23 at the time of photoshooting, and stores the photo-shooting information 212 in the memory21. Note that the photo-shooting information 212 includes a focal lengthacquired from the imaging unit 22 in addition to location informationacquired from the GPS, posture information acquired from theacceleration sensor, and photo-shooting direction information acquiredfrom the electronic compass.

The communication portion 202 transmits the image information 211 andthe photo-shooting information 212, which corresponds to the imageinformation 211, via the communication unit 24 to the informationprocessing server 1.

The catalog information receiving portion 203 receives cataloginformation 213 from the information processing server 1 and stores thecatalog information 213 in the memory 21.

The catalog display portion 204 displays the catalog information 213 onthe display 25.

The memory 21 stores the portable terminal control program 210, theimage information 211, the photo-shooting information 212, the cataloginformation 213, and the like, the portable terminal control program 210causing the controller 20 to operate as the above-described portions 200to 204.

FIG. 4 is a schematic diagram illustrating an example of theconfiguration of the product information 111.

The product information 111 includes a product ID for identifying aproduct, a shop ID for identifying a shop that handles the product, animage ID for identifying image information, an image represented by theimage information including the product, a photographer ID foridentifying a user who has captured the image represented by the imageinformation, a photo-shooting location indicating a place where theimage represented by the image information is captured, and meta taginformation indicating information on the product.

FIG. 5 is a schematic diagram illustrating an example of theconfiguration of the shop information 112.

The shop information 112 includes a shop ID for identifying a shop thathandles a product, a shop location indicating the location of the shop,and an e-mail address, a URL, and a telephone number as examples of theshop's contact information.

FIG. 6 is a schematic diagram illustrating an example of theconfiguration of the catalog information 113.

The catalog information 113 includes a user ID for identifying a user,an image ID for identifying image information of an image captured bythe user, a product ID for identifying a product included in the imagerepresented by the image information, and a product name, a price, ashop name, a stock, and a rating as examples of information on theproduct.

(Operation of Information Processing Apparatus)

Next, an explanation of an operation of the present exemplary embodimentwill be divided and made as in (1) an operation on the side of theportable terminal 2, (2) an operation on the side of the informationprocessing server 1, and (3) a shop determination operation.

(1) Operation on Side of Portable Terminal 2

FIGS. 7A to 7C are schematic diagrams illustrating an example of anoperation on the side of the portable terminal 2.

First, as illustrated in FIG. 7A, for example, suppose that a product300 a captures the interest of the user 4 at the shop 30 a. Then, asillustrated in FIG. 7B, the user 4 captures an image of the product 300a using the portable terminal 2.

When a photo-shooting button is operated, the imaging portion 200 of theportable terminal 2 generates the image information 211, an imagerepresented by the image information 211 including the product 300 a. Atthe same time, the photo-shooting information acquisition portion 201acquires the photo-shooting information 212 by acquiring locationinformation using the GPS, acquiring a photo-shooting posture and aphoto-shooting direction using the acceleration sensor, the electroniccompass, and the like, and acquiring a focal length using the camera.

The communication portion 202 transmits the image information 211 of theimage of the product, the image has been captured, and thephoto-shooting information 212 (the location information, thephoto-shooting direction, and the focal length) via the network 5 to theinformation processing server 1. Next, after a process explained in thefollowing “(2) Operation on Side of Information Processing Server 1” isperformed by the information processing server 1, the cataloginformation receiving portion 203 receives, as the catalog information213, the catalog information 113 in which information on the productgenerated by the information processing server 1 is associated withimage information, and the catalog display portion 204 performs displayon the display 25 of the portable terminal 2 as illustrated in FIG. 7C.

As illustrated in FIG. 7C, as an example, images that the user hascaptured and that are represented by image information 25 a to 25 f aredisplayed on the display 25 of the portable terminal 2 in a list format.

Next, the user 4 views a catalog using the portable terminal 2, andperforms an operation for selecting an image from among the imagesrepresented by the image information 25 a to 25 f if there is a productthat captures the interest of the user 4.

As illustrated in FIG. 7D, detailed information 250 a on the productselected by the user 4 is displayed on the display 25 of the portableterminal 2. If necessary, the user 4 performs a purchase operation. Theportable terminal 2 transmits a purchase request to the informationprocessing server 1.

(2) Operation on Side of Information Processing Server 1

FIG. 8 is a flowchart illustrating an example of an operation of theinformation processing server 1.

First, the image receiving portion 100 receives image information of animage captured by the portable terminal 2 and transmitted from theportable terminal 2 (S1).

In addition, the photo-shooting information receiving portion 101receives photo-shooting information transmitted together with the imageinformation from the portable terminal 2 (S1). Here, the photo-shootinginformation refers to the location information, which indicates thelocation of the portable terminal 2, the photo-shooting direction, andthe focal length at the time when the image represented by the imageinformation received by the image receiving portion 100 is captured.

The product management portion 103 performs registration in the productinformation 111 such that information on a product included in the imageinformation is associated with the image information. Since theinformation on the product is unknown at the time when the imageinformation is received by the image receiving portion 100, registrationis performed such that the information on the product is left blank(S2). For example, although all items are registered in the example ofFIG. 4, in the case where a user having a photographer ID of “005”captures an image represented by image information having an image ID of“00017”, the product ID, the shop ID, and meta tag information are leftblank at that point in time.

Next, the shop management portion 102 determines the location of theproduct in accordance with the photo-shooting information received bythe photo-shooting information receiving portion 101, and determines ashop that handles the product, which is included in the imagerepresented by the image information, by searching for the shop usingthe information registered in the shop information 112 (S3).Specifically, a location is determined which is located in thephoto-shooting direction acquired by the acceleration sensor and theelectronic compass and is the focal length away from the locationindicated by the location information acquired from the GPS in thephoto-shooting information, the focal length being acquired by theimaging unit 22. Then, a shop is determined the shop location of whichillustrated in FIG. 5 is closest to the location, and the product isassociated with the shop. Note that a determination method for the casewhere there are plural candidates for the shop will be described laterin “(3) Shop Determination Operation”.

The product management portion 103 registers the shop ID of the shopdetermined by the shop management portion 102 in the shop ID left blankin the product information 111 illustrated in FIG. 4 (S4).

Next, the product confirmation portion 104 transmits the imageinformation to a terminal of the shop determined by the shop managementportion 102 and requests confirmation of information on the productincluded in the image represented by the image information (S5). In thecase where a reply is received from the shop (Yes in S6), the productconfirmation portion 104 receives the information on the producttransmitted from the shop and registers the information in the meta taginformation in the product information 111 (S7). At the shop, a shopclerk or the like checks the image information that has reached theterminal, and returns information on the product included in the imagerepresented by the image information to the information processingserver 1. Note that the terminal in the shop may automatically determinethe product and return information on the product.

Note that in the case where meta tag information is present that is thesame as that of a product that has already been registered, that is, inthe case where, for example, meta tag information is present that is thesame as that of a product having a product ID of “001” corresponding toan image represented by image information having an image ID of “00104”and captured by a photographer having a photographer ID of “007” and animage represented by image information having an image ID of “00030” andcaptured by a photographer having a photographer ID of “013” illustratedin FIG. 4, the image information having an image ID of “00017” andrepresenting an image captured by the photographer having a photographerID of “005” is registered by treating the product corresponding to theimage ID of “00017” and the product corresponding to the image IDs of“00104” and “00030” as the same products.

In addition, in the case where information on a product the same as theproduct included in the image represented by the image information hasbeen registered in advance in the memory 11 or in the case whereinformation may be acquired from a web site or the like in the Internet,the meta tag management portion 105 registers the information as metatag information in the product information 111. Note that a search forthe information may be made using a similar image or a product name, orusing location information. The information may also be information onthe shop. The reliability of meta tag information acquired by otherportions may also be set to be lower than that of meta tag informationthat has been registered in the memory 11 in advance by the informationprocessing server 1.

Next, for each user ID in accordance with the product information 111,the catalog generation portion 106 associates the image information withthe information on the product and generates the catalog information 113as illustrated in FIG. 6 (S8). The example of FIG. 6 illustrates thecatalog information 113 corresponding to a user ID of “005”.

Next, the catalog display portion 107 performs processing to display thecatalog information 113 on the portable terminal 2 (S9). As illustratedin FIG. 7D, display is performed such that image information of an imagecaptured by the portable terminal 2 is associated with information on aproduct included in the image information.

Next, as illustrated in FIG. 7D, in the case where a “purchase button”for placing an order for the product is operated at the portableterminal 2 (Yes in S10), the product order portion 108 performs aprocess for placing an order for the product with the shop that handlesthe product (S11).

(3) Shop Determination Operation

FIGS. 9A and 9B are schematic diagrams illustrating an example of anoperation of the shop management portion 102.

Although the shop management portion 102 determines, in step S3described above, a shop that handles the product, which is included inthe image represented by the image information, by searching for theshop using the information registered in the shop information 112 inaccordance with the photo-shooting information received by thephoto-shooting information receiving portion 101, first, the shopmanagement portion 102 determines whether or not location information ofthe photo-shooting information is included in a predetermined width froma shop location included in the shop information 112 illustrated in FIG.5.

As illustrated in FIG. 9A, the predetermined width from a shop locationincluded in the shop information 112 is, for example, a space havingx_(a1)<x<x_(a2), 0<y<y₁, and 0<z<z₁ for the shop 30 a and a space havingx_(b1)<x<x_(b2), 0<y<y₁, and 0<z<z₁ for the shop 30 b.

For example, in the case where the location information of the imageinformation is P₁ (x_(a1)<x<x_(b1)), the shop management portion 102determines that product information included in the image information ishandled by the shop 30 a. In the case where the location information ofthe image information is P₃ (x_(a2)<x<x_(b2)), the shop managementportion 102 determines that product information included in the imageinformation is handled by the shop 30 b.

Here, for P₂ (x_(b1)<x<x_(a2)) that is an area where the spaces overlap,it is not possible to determine whether the area belongs to either theshop 30 a or 30 b. Thus, as illustrated in FIG. 9B, the shop managementportion 102 calculates a luminance barycenter B_(c) of an imagerepresented by image information 100 a, and determines whether the areabelongs to either the shop 30 a or 30 b in accordance with whether thecoordinates of the luminance barycenter B_(c) are in a negativedirection or in a positive direction from the center of the imagerepresented by the image information in the x direction, which isx=x_(c). In the example illustrated in FIGS. 9A and 9B, the shopmanagement portion 102 determines that, in the case where thecoordinates are in the negative direction, the product is handled by theshop 30 a and that, in the case where the coordinates are in thepositive direction, the product is handled by the shop 30 b.

Other Exemplary Embodiments

Note that the present invention is not limited to the above-describedexemplary embodiment, and various modifications may be made withoutdeparting from the scope of the present invention.

For example, the exemplary embodiment of the present invention may alsobe applied even to roadside stands as long as the locations of theroadside stands are registered. In addition, in the case of a roadsidestand, an identification mark such as a barcode, a QR Code®, or the likeis presented near the area where the roadside stand is located,information is registered in which the identification mark is associatedwith the location of the roadside stand, and a user may capture an imageof a product and the identification mark at the same time. As a result,the exemplary embodiment of the present invention may also be appliedeven to portable terminals having no GPS, no acceleration sensor, noelectronic compass, and the like.

Note that some or all of the functions of the information processingserver 1 may be executed by the portable terminal 2, or some or all ofthe functions of the portable terminal 2 may be executed by theinformation processing server 1.

In addition, shops may not only be independent shops but also be afacility such as a shopping center having plural shops. In this case, ashop where an image of a product is captured is determined in thefacility.

In the above-described exemplary embodiment, the functions of theportions 100 to 108 of the controller 10 are realized by a program;however, some or all of the portions may also be realized by a hardwaredevice such as an ASIC or the like. In addition, the program used in theabove-described exemplary embodiment may also be stored in a recordingmedium such as a CD-ROM or the like and provided. In addition, the orderof the above-described steps explained in the above-described exemplaryembodiment may be changed, some of the above-described steps may beremoved, new steps may be added to the above-described steps, or thelike without changing the spirit and scope of the present invention.

The foregoing description of the exemplary embodiment of the presentinvention has been provided for the purposes of illustration anddescription. It is not intended to be exhaustive or to limit theinvention to the precise forms disclosed. Obviously, many modificationsand variations will be apparent to practitioners skilled in the art. Theembodiments were chosen and described in order to best explain theprinciples of the invention and its practical applications, therebyenabling others skilled in the art to understand the invention forvarious embodiments and with the various modifications as are suited tothe particular use contemplated. It is intended that the scope of theinvention be defined by the following claims and their equivalents.

What is claimed is:
 1. A non-transitory computer readable medium storinga program causing a computer to execute a managing process, the managingprocess comprising: determining a location of a photo-shooting targetbased on photo-shooting information of image information, the imageinformation being generated by capturing the photo-shooting target; andassociating at least one shop with the captured image, with reference tolocation information of a plurality of shops that has been registered inadvance.
 2. The non-transitory computer readable medium according toclaim 1, the managing process further comprising: confirming an item bytransmitting the image information to the shop with which the capturedimage is associated, and by receiving information regarding thephoto-shooting target from the shop; and generating catalog informationby associating the received information regarding the photo-shootingtarget with the image information.
 3. The non-transitory computerreadable medium according to claim 1, the managing process furthercomprising: determining the shop from a plurality of candidates based ona luminance barycenter of the image information.
 4. The non-transitorycomputer readable medium according to claim 2, the managing processfurther comprising: determining the shop from a plurality of candidatesbased on a luminance barycenter of the image information.
 5. Thenon-transitory computer readable medium according to claim 2, themanaging process further comprising: in a case where the imageinformation is selected from the catalog information, placing an orderfor the photo-shooting target with the shop associated with the selectedimage information.
 6. The non-transitory computer readable mediumaccording to claim 1, the managing process further comprising:associating the shop with the captured image, the shop having locationinformation which is within a predetermined width from the location ofthe photo-shooting target.
 7. The non-transitory computer readablemedium according to claim 2, the managing process further comprising:associating the shop with the captured image, the shop having locationinformation which is within a predetermined width from the location ofthe photo-shooting target.
 8. The non-transitory computer readablemedium according to claim 3, the managing process further comprising:associating the shop with the captured image, the shop having locationinformation which is within a predetermined width from the location ofthe photo-shooting target.
 9. The non-transitory computer readablemedium according to claim 4, the managing process further comprising:associating the shop with the captured image, the shop having locationinformation which is within a predetermined width from the location ofthe photo-shooting target.
 10. The non-transitory computer readablemedium according to claim 5, the managing process further comprising:associating the shop with the captured image, the shop having locationinformation which is within a predetermined width from the location ofthe photo-shooting target.
 11. An information processing apparatuscomprising: a management unit that determines a location of aphoto-shooting target based on photo-shooting information of imageinformation, the image information being generated by capturing thephoto-shooting target, and associates at least one shop with thecaptured image, with reference to location information of a plurality ofshops that has been registered in advance.
 12. An information processingmethod comprising: determining a location of a photo-shooting targetbased on photo-shooting information of image information, the imageinformation being generated by capturing the photo-shooting target; andassociating at least one shop with the captured image, with reference tolocation information of a plurality of shops that has been registered inadvance.